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Description 

[0001] Method of displaying navigational guidance information for a vehicle in an image of the vehicle environment, 
a navigational system for performing the method, and a vehicle comprising a navigation system. 
5 [0002] The invention relates to a method for displaying navigational guidance information provided by a navigation 
system for a vehicle, said information being superposed on a scenic image associated with a vehicle position. JP-A- 
62-93614 describes a running guidance apparatus for vehicle: 

[0003] A map, the actual images of a plurality of predetermined points on said map and information necessary for 
running guidance such as a plurality of direction indicating marks are preliminarily stored in a memory means like a 

10 compact disk. A running route from the present area to an objective area is set to a control circuit on the basis of the 
present point information from a present position recognizing apparatus and the destination area information from a 
destination area indicating means. Then, the present area information is collated with the stored informations and, 
when it is detected that the vehicle has approached one of the predetermined points, the image of the predetermined 
point and the direction indicating mark are displayed on a display device in a superposed state on the basis of the set 

15 running route. 

[0004] The present invention recognises the need for superposing the navigational guidance information on a scenic 
image that is true to life and not subaltern to the navigation system, for so keeping a user person in close contact with 
reality. Amongst other things, it is an object of the present invention to provide a method of displaying navigation an 
guidance information for a vehicle in an image of the local vehicle environment which allows for a simple, user friendly 
20 and readily interpretable display of the navigation data. 

[0005] The invention is characterized in that said image is real-time and independent from said information procure- 
ment system as being generated instantaneously and continually by a video or television camera that is physically 
joined to the vehicle. 

25 BRIEF DESCRIPTION OF THE FIGURES 

[0006] 

Fig. 1 shows a flowchart of a method in accordance with the invention; 
30 Fig. 2 diagrammatically shows the structure of a navigation system suitable for performing the method in accord- 

ance with the invention; 

Fig. 3 shows examples of a local image for display on a display unit in combination with navigation data; 
Fig. 4 illustrates the data structure used; 
Fig. 5 illustrates the sorting of the connections; 
35 Fig. 6 illustrates the conversion into polygons. 

DESCRIPTION OF THE FIGURES 

[0007] Fig. 1 shows a flowchart of a method in accordance with the invention. In block 1 1 an image of the environment 
40 is generated by means of an image pick-up unit, for example a video camera aboard a vehicle. In block 12, known 
from the article "CARIN, a car information and navigation system" by M.L.G. Thoone, Philips Technical Review, Vol. 
43, No. 11/12, pp. 317-329, December 1987, the navigation data to be displayed therein are generated; in block 13 an 
indication signal is formed therefrom, for example by means of a known video generator, which indication signal is 
superposed in block 14, for example by means of a video combination module, on the environment image. In block 15 
« the combination is displayed on a display unit, for example a video display, a television receiver or a monitor, aboard 
the vehicle. 

[0008] Fig. 2 diagrammatically shows the structure of a navigation system suitable for performing the method in 
accordance with the invention. Module 21 is a known car navigation system, for example a CARIN system as described 
in the cited article by M.L.G. Thoone, which supplies navigation data on the basis of measurement data from sensors 

50 (such as a compass and wheel sensors which measure the number of revolutions) and topographic data in a data 
structure, for example coordinates which represent the current position of the vehicle and coordinates which represent 
a calculated optimum route to be followed. In module 22 this navigation data is subjected to a transformation in ac- 
cordance with the position of the image pick-up unit 24 with respect to the environment: the relevant area of the data 
structure containing the topographic data is "viewed" from the point of view of the image pick-up unit as described in 

55 the previously filed, non-prepublished Netherlands Patent Application No. 8900056 (= PHN 12.810). Navigation data 
to be displayed, for example indications of the route to be followed, thus correspond to the roads in the local image of 
the environment. Module 23 is a video generator which forms an indication signal from the transformed navigation 
data: for example, a stylistic indication of the route to be followed. Image pick-up unit 24 (a video camera or television 
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camera) supplies an image of the environment. In a combination module 25 the indication signal and the environment 
image are combined so as to form a combined signal which is displayed on display unit 26 (a video display, television 
receiver or monitor). 

[0009] Fig. 3 shows an example of a display of an image of the environment in combination with stylized navigation 
s data. The arrow indicates the direction to be followed as calculated by the navigation system: in this case indication 
to turn left, which indication is overlaid on the road section to be followed. When the navigation data is displayed in a 
distinct manner, for example in a flashing or boxed manner, or in a bright colour which is distinct from the remainder 
of the image, the user will see how to act at one glance. In the CARIN data base roads are represented by the coor- 
dinates of their centre lines. For a realistic display on a display unit, it is important to convert this representation into 
10 a representation by way of polygons which is compatible with the realistic image of the environment. To this end, the 
structure in the CARIN data base is converted into a new structure whose most important categories are: 

nodes (P), each of which is represented by two coordinates (or three coordinates if the data base also contains 
information as regards altitude); 
15 . roads (R), each of which is represented by the number and location of the constituent nodes; 
links (L), each of which is represented by the associated road and its direction; 
intersections (I), each of which is represented by the number and the location of the constituent links. 

[001 0] The category of links is extended to p-links (PL) by including also the left-hand and the right-hand side of the 
20 road; the list of roads and nodes is thus increased (the left-hand and the right-hand side of the road also constitute a 
separate road defined by nodes), but the structure remains the same, see Fig. 4. Subsequently, for each intersection 
the links leading thereto are sorted in a counterclock-wise fashion. This is realised as follows: the first link L0 referred 
to acts as a reference. If the angle between this link L0 and the next link L1 is greater than the angle between L0 and 
the subsequent link L2, L1 and L2 are interchanged in the list of links, see Fig. 5. 
25 The cosine and the sine of the angle aO enclosed by the link LO with respect to the positive X-axis are: 

cos(aO) = (xOB - xOA) / SQRT ((xOB - xOA) 2 + (yOB - yOA) 2 ); 
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sin(aO) = (yOB - yOA) / SQRT ((xOB - xOA) 2 + (yOB - yOA) 2 ); 



and the same is applicable to the links L1 and L2. 
It follows therefrom that 



cos(a10) = cos(a1 - aO) = cos(a1) * cos(aO) + sin(a1) * sin(aO); 

40 sin(a10) = sin(a1 - aO) = sin(a1) * cos(aO) - cos(a1) * sin(aO); 

and the same is applicable to cos(a20) and sin(a20). 
The sequence is then determined as follows: 
if sin(a10) > 0 
45 subsequently if sin(a20) > 0 

subsequently if cos(a10) > cos(a20) 
do not interchange, 
and otherwise interchange 
otherwise do not interchange 
50 otherwise if sin(a20) > 0 

interchange 

otherwise if cos(a10) < cos(a20) 
do not interchange 
otherwise interchange. 

55 [0011] Subsequently, for each intersection the centre line of all links departing from the respective intersection is 
converted into a polygon, see Fig. 6. 

[0012] For all points, except for the terminal points, the point of intersection of adjoining left-hand and right-hand 
road sides is calculated. The vector having the length D1, perpendicular to PQ, is given by: 
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10 



15 



(xpq.ypq), where xpq = - (yq - yp) * gpq and ypq = (xq - xp) * gpq, where gpq = D1 / SQRT((xq - xp) 

+ (yq - yp) 2 ). 

To the vector perpencidular to QR, having the length D2, an analogous expression is applicable: 

(xqr.yqr), where xqr = - (yr - yq) * gqr and yqr = (xr - xq) * gqr, where gqr = D2 / SQRT((xr - xq) 2 + (yr - 

yq) 2 ). 

The point of intersection (xs.ys) searched is the point of intersection of the line between (xp+xpg f yp+ypg) and (xq+xpq, 
yq+ypq) and the line between (xq+xqr, yq+yqr) and (xr+xqr t yr+yqr). The following is applicable: 

xs = xpq + n * xp + (1 - n) * xq and ys = ypq + n * yp + (1 - n) * yq ; 

20 xs = xqr + m * xq + (1 - m) * xr and ys = yqr + m * yq + (1 - m) * yr ; 

solution of these equations for the parameter n results in: 

25 n = I (yq - y) * (xpq + xq - xqr - xr) - (xq - xr) * 

(ypq + yq - yqr - yr) ] / / [(xq - xr) * (yp - yq) - (yq - 

yr) * (xp - xq) ] 

30 

If the denominator is zero, the two line segments are situated one in the prolongation of the other and the parameter 
n is assumed to equal zero. 

The point of intersection (xs,ys) has thus been found. 

Each centre line has thus been supplemented so as to form a real street having a given width. 
35 [0013] Finally, all polygons thus found are coupled to the associated intersections. Because the links have been 
sorted while proceeding counterclock-wise, each time the point of intersection of the left-hand edge of a link with the 
right-hand edge of the next link is calculated. The calculations are fully analogous to the foregoing. 
[0014] The network of roads consisting of "dashed roads" has thus been converted into a network of "real" roads. 
The navigation data can now be positioned so as to correspond better to the image of the environment. 

40 

Claims 

1. A method for displaying navigational guidance information provided by a navigation system (12,1 3) for a vehicle, 
45 said information being superposed (1 4) on a scenic image associated with a vehicle position, characterized in that 

said image is real-time and independent from said navigation system (12, 13) as being generated (11) instanta- 
neously and continually by a video or television camera (24) that is physically joined to the vehicle. 

2. A method as claimed in Claim 1 , where the navigational guidance information is generated by the navigation system 
so on the basis of measurement data from sensors and/or topographic data from a data structure, characterized in 

that prior to the superposing, the navigational guidance information is transformed in conformity with a position of 
the video or television camera with respect to the environment. 

3. A method as claimed in Claim 2, characterized in that the navigational guidance information is transformed by way 
55 of a perspective transformation. 

4. A method as claimed in any one of the Claims I to 3, characterized in that the navigational guidance information 
is displayed in a manner distinct from the remainder of the image. 
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5. A method as claimed in any one of the Claims 1 to 4, where the navigational guidance information is generated 
by the navigation system on the basis of measurement data from sensors and topographic data from a data struc- 
ture in which roads are represented by co-ordinates of their centre lines, characterized in that prior to the super- 
posing of the navigational guidance information, the representation of the roads is converted into a representation 
by polygons. 

6. A navigation system arranged for executing a method as claimed in any of Claims 1 to 5, comprising an information 
procurement system for providing navigational guidance information (21), a scenic image providing system for 
providing a scenic image associated with a particular vehicle position and display superposition (25) means fed 
in parallel by said information procurement system, and by said scenic image providing system, characterized in 
that said scenic image providing system is arranged for operating real-time and independently of said information 
procurement system by comprising a video or television camera (1 1 , 24) that is physically joined to the vehicle for 
instantaneously and continuously producing said scenic image, a transformation module (22) for transforming the 
navigational guidance information produced by the information procurement system, a video generator (24) for 
generating an indication signal from the transformed navigational guidance information, a combination unit (25) 
for combining the scenic image with the video transformed indication signal, and a display (26) unit for displaying 
the combined signals. 



Patentanspruche 

1. Verfahren zur Wiedergabe von Navigationsleitinformationen, die von einem Navigationssystem (12,13) fur ein 
Fahrzeug geliefert werden, wobei diese Informationen einem Szenenbiid uberlagert (14) werden, das einer Fahr- 
zeugposition zugeordnet ist, dadurch gekennzeichnet, daft das genannte Bild ein Echtzeit-Bild und unabhangig 
von dem Navigationssystem (12,13) ist, da es unmittelbarund kontinuierlich von einer Video- Oder Fernsehkamera 
(24) erzeugt (11) wird, die physisch mit dem Fahrzeug verbunden ist. 

2. Verfahren nach Anspruch 1 , bei dem die Navigationsleitinformationen auf der Basis von Meftdaten von Sensoren 
und/oder topografischen Daten aus einer Datenstruktur von dem Navigationssystem erzeugt werden, dadurch 
gekennzeichnet, daft vor dem Uberlagern die Navigationsleitinformationen entsprechend einer Position der Video- 
oder Fernsehkamera relativ zur Umgebung transformiert werden. 

3. Verfahren nach Anspruch 2, dadurch gekennzeichnet, daft die Navigationsleitinformationen mittels perspektivi- 
scher Transformation transformiert werden. 

4. Verfahren nach einem der Anspruche 1 bis 3, dadurch gekennzeichnet, daft die Navigationsleitinformationen in 
einer solchen Weise wiedergegeben werden, dass sie sich vom Rest des Bildes unterscheiden. 

5. Verfahren nach einem der Anspruche 1 bis 4, bei dem die Navigationsleitinformationen von dem Navigationssy- 
stem auf der Basis von Meftdaten von Sensoren und topografischen Daten aus einer Datenstruktur erzeugt wer- 
den, in der Straften durch Koordinaten ihrer Mittellinien dargestellt werden, dadurch gekennzeichnet , daft vor dem 
Uberlagern der Navigationsleitinformationen die Darstellung der Straften in eine Darstellung durch Polygone urn- 
gesetzt wird. 

6. Navigationssystem zur Ausfiihrung eines Verfahrens nach einem der Anspruche 1 bis 5 mit einem Informations- 
verschaffungsystem zur Verschaffung von Navigationsleitinformationen (21), einem Szenenbildverschaffungssy- 
stem zur Lieferung eines Szenenbildes, das einer bestimmten Fahrzeug position zugeordnet ist, und Wiedergabe- 
uberlagerungsmitteln (25), die vom genannten Informationsverschaffungssystem und vom genannten Szenenbiid- 
verschaffungssytem parallel gespeist werden, dadurch gekennzeichnet , daft das Szenenbildverschaffungssystem 
fur Echtzeitbetrieb vorgesehen ist und unabhangig vom genannten Informationsverschaffungssystem arbeitet, in- 
dem es eine Video- oder Fernsehkamera (11,24) umfaftt, die physisch mit dem Fahrzeug verbunden ist, urn un- 
mittelbar und kontinuierlich das genannte Szenenbiid zu erzeugen, ein Transformationsmodul (22) zur Transfor- 
mation der durch das Informationsverschaffungssytem erzeugten Navigationsleitinformationen, einen Videogene- 
rator (24) zur Erzeugung eines Anzeigesignals aus den transformierten Navigationsleitinformationen, eine Kom- 
binationseinheit (25) zur Kombination des Szenenbildes mit dem videotransformierten Anzeigesignal, sowie eine 
Wiedergabeeinheit (26) zur Wiedergabe der kombinierten Signale. 
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Revendi cations 

1. Procede pour afficher des informations de guidage et de navigation fournies par un systeme de navigation (12, 
13) pour un vehicule, lesdites informations etant superposees (14) a une image scenique associee a une position 
du vehicule, caracterise en ce que ladite image est en temps reel et est independante dudit systeme de navigation 
(12, 13) dans la mesure ou elle est generee (11) instantanement et continuellement par une camera video ou une 
camera de television (24) qui est physiquement reliee au vehicule. 

2. Procede selon la revendication 1 , suivant lequel les informations de guidage et de navigation sont generees par 
le systeme de navigation sur la base de donnees de mesure provenant de capteurs et/de donnees topographiques 
provenant d'une structure de donnees, caracterise en ce que, avant la superposition, les informations de guidage 
et de navigation sont transformees en conformite avec une position de la camera video ou de la camera de tele- 
vision par rapport au voisinage. 

3. Procede selon la revendication 2, caracterise en ce que les informations de guidage et de navigation sont trans- 
formees par transformation en perspective. 

4. Procede selon Tune quelconque des revendications precedentes 1 a 3, caracterise en ce que les informations de 
guidage et de navigation sont affichees d'une maniere distincte de celle du restant de I'image. 

5. Procede selon I'une quelconque des revendications precedentes 1 a 4, suivant lequel les informations de guidage 
et de navigation sont generees par le systeme de navigation sur la base de donnees de mesure provenant de 
capteurs ou de donnees topographiques provenant d'une structure de donnees dans laquelle des routes sont 
representees par des coordonnees de leurs axes, caracterise en ce que, avant la superposition des informations 
de guidage et de navigation, la representation des routes est convertie en une representation par polygones. 

6. Systeme de navigation concu pour mettre en oeuvre un procede selon I'une quelconque des revendications pre- 
cedentes 1 a 5, comprenant un systeme de fourniture d'informations pour foumir des informations de guidage et 
de navigation (21), un systeme de fourniture d'une image scenique pour fournir une image scenique associee a 
une position particuliere du vehicule, et des moyens de superposition d'afflchage (25) alimentes en parallele par 
ledit systeme de fourniture d'informations et par ledit systeme de fourniture d'image scenique, caracterise en ce 
que ledit systeme de fourniture d'image scenique est concu pour operer en temps reel et independamment dudit 
systeme de fourniture d'informations dans la mesure ou il comprend une camera video ou une camera de television 
(11, 24) qui est physiquement reliee au vehicule pour produire instantanement et continuellement ladite image 
scenique, un module de transformation (22) pour transformer les informations de guidage et de navigation pro- 
duces par le systeme de fourniture d'informations, un generateur d'images video (24) pour generer un signal 
indicateur a partir des informations de guidage et de navigation transformees, une unite de combinaison (25) pour 
combiner I'image scenique avec le signal indicateur transforme video, et une unite d'affichage (26) pour afficher 
les signaux combines. 
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